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Title: CYCLIZED FLUORESCENT DNA-INTERCAU\TING CYANINE DYES 



FIELD OF THE INVENTiON 

The present invention relates generally to dyes for labelling nucleic acids. 
More specifically, the present invention relates to intercalating cyanine dyes for 
the detection and enumeration of nucleic acids. 

BACKGROUND OF THE INVENTION 

Intercalating dyes which exhibit enhanced fluorescence upon binding to 
DNA or RNA are a basic tool in molecular and cell biology. In general, 
intercalating dyes bind noncovalently to DNA through a combination of 
hydrophobic interactions with the DNA base-pairs and ionic binding to the 
negatively charged phosphate backbone. The fluorescence of the dye is 
ideally increased several-fold upon binding to DNA, thereby enabling the 
detection of small amounts of nucleic acids. Examples of fluorescent 
noncovalent DNA binding dyes include ethidium bromide which is commonly 
used to stain DNA in agarose gels after gel electrophoresis, and propidium 
iodide and Hoechst 33258 which are used in flow cytometry to detenmine the 
DNA ploidy of cells. 

Fluorescent nucleic acid labelling dyes preferably absorb light between 
about 300 and 900 nm and preferably have a Stokes shift of at least about 10 
nm. Dyes that absorb light in the 500 to 900 nm range are prefen-ed because 
they are spectrally removed from other components that may be present in a 
biological sample and because they may be used with inexpensive light 
sources. Fluorescent dyes that have a high extinction coefficient, a high 
quantum yield, and significantly enhanced fluorescence when bound to a 
nucleic acid are also prefen-ed. 

Few new dye chromophores were described until the introduction of 
Thiazole Orange as a reticulocyte stain in 1986. Lee, et al., 'Thiazole Orange: 
A New Dye for Reticulocyte Analysis", Cytometry 1986 7, 508-517. Thiazole 
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Orange is an asymmetric cyanine dye. Although many asymmetric cyanine 
dyes have been described in the art (e.g., Lincoln, et al., U.S. Patent No. 
3,282,932), Thiazole Orange's fluorescence properties when bound to DNA 
and RNA and its utility for labelling nucleic acids had not been previously 
identified. Lee, et a!.. U.S. Patent No. 4,957,870. For example, unlike most 
asymmetric cyanine dyes, Thiazole Orange exhibits a several thousand-fold 
enhancement in fluorescence upon binding to DNA. 

Since the discovery of Thiazole Orange as a nucleic add dye, several 
improvements to Thiazole Orange and its trimethine homologs have been 
developed to provide dyes with tighter binding to DNA and greater water 
solubility. Xue, et al. U.S. Patent No. 5,321,130 and Glazer, et al. U.S. Patent 
No. 5,312,921. These dyes generally involve a modification to the quinolinium 
portion of the dye. 

A continuing need exists for new and improved dyes for labelling nucleic 
acids. In particular, a need exists for dyes which exhibit longer wavelengths 
and significantly enhanced fluorescence when bound to DNA or RNA. 
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.qilMMARY OF THE INVENTION 

The present invention relates asymmetric cyanine dyes for non- 
covalently labelling nucleic acids in which the benzothiazole portion of the dye 
has been modified to provide improved physical properties to the dye, such as 
5 longer wavelengths and improved fluorescence enhancement when bound to 

DNA or RNA. 

More specifically, the invention relates to cyclized fluorescent cyanine 
dyes for non-covalently labelling nucleic acids. The cydized fluorescent 
cyanine dyes according to the present invention are represented by General 
10 Formula I 




where: 

n is 0, 1 or 2; 

1 5 Y may be either S or O; 

Ri and Rj are taken together to form a 5. 6. 7 or 8 
membered ring; 

R3 and R4 may each independently be either hydrogen. C, 
- Cio alkyl. C, - C,o alkoxy, or - C^o alkylthio; 
20 Rfi may be a C, - C50 alkyi, preferably substituted with one 

or more polar substituents which preferably includes one or more 
positively charged atoms, or a cyclized fluorescent cyanine dye of the 
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present invention, i.e., where R5 is a linker between two cyclized 
fluorescent cyanine dyes; 

Re and R7 may each independently be either H or C^.^o 
alkyl. or may be taken together to form a 5 or 6 membered ring, most 
preferably a 6 membered aromatic ring, optionally substituted with C,^ 
alkyl or - C^o alkoxy groups; 

Ra and R^ may each independently be either H or C1.10 
alkyl, or may be taken together to fomi a 5 or 6 membered ring, most 
preferably a 6 membered aromatic ring, optionally substituted with C^^ 
alkyl or - Cio alkoxy groups; and 

R,o may be either H, C,^ alkyl, C, - 0,0 alkoxy or a fused 

benzene. 

As used above, alkyl and alkoxy refer to any substituent having a carbon 
backbone having the specified range of carbon atoms. The carbon backbone 
may form a straight chain, may be branched or may be cyclic. The alkyl and 
alkoxy groups may be optionally substituted by a wide variety of substituents 
including, for example, alcohols, amines, thiols, phosphates, halides, ethers, 
esters, ketones, aldehydes, carboxylic acids, amides, cycloalkyls, and aromatic 
rings. 

The invention also relates to the composition of a cyanine dye according 
to the present invention non-covalently bound to a nucleic acid sequence, i.e., 
RNA or DNA, which enables the nucleic acid sequence to be analytically 
detected. 

The invention also relates to a method for detecting nucleic acids in a 
sample by contacting the nucleic acids with a fluorescent cyanine dye 
according to the present invention and monitoring the change in fluorescence 
emission of the dye. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates asymmetric cyanine dyes for non- 
covalently labelling nucleic acids in which the benzothiazole portion of the dye 
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has been modified to provide improved physical properties to the dye. such as 
longer wavelengths and improved fluorescence enhancement when bound to 
DNA or RNA. 

In one embodiment, the present invention relates to cyclized fluorescent 
cyanine dyes generally represented by General Formula I 




R8 R9 

where: 

n is 0. 1 or 2; 

Y may be either S or O; 

and are taken together to form a 5, 6. 7 or 8 membered 

ring; 

R3 and R4 may each independently be either hydrogen. C, - C^o 
alkyl. C, - C10 alkoxy, or C, - C^o alkylthio; 

R5 may be a - C50 alkyl. preferably substituted with one or 
more polar substituents which preferably includes one or more positively 
charged atoms, or a cyclized fluorescent cyanine dye of the present invention, 
i.e., where R5 is a linker between two cyclized fluorescent cyanine dyes; 

R5 and R7 may each independently be either H or C^.,© alkyl or 
may be taken together to form a 5 or 6 membered ring, most preferably a 6 
membered aromatic ring, optionally substituted with C,^ alkyi or C, - C^o alkoxy 
groups; 

Ra and may each independently be either H or C,.io alkyI, or 
may be taken together to form a 5 or 6 membered ring, most preferably a 6 
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membered aromatic ring, optionally substituted with C,^ alky! or - Cio alkoxy 
groups; and 

R,o may be either H, C^^ alkyl. C, - C,o alkoxy or a fused 

benzene. 

As used above, alkyl and alkoxy refer to any substituent having a carbon 
backbone having the specified range of carbon atoms. The carbon backbone 
may form a straight chain, may be branched or may be cyclic. The alkyl and 
alkoxy groups may be optionally substituted by a wide variety of substituents 
including, for example, alcohols, amines, thiols, phosphates, halides. ethers, 
esters, ketones, aldehydes, carboxylic adds, amides, cycloalkyls. and aromatic 
rings. 

The cyclized cyanine dyes of the present invention provide the 
advantage over previous cyanine dyes of having higher absorbance and 
emission wavelengths. The cyclized cyanine dyes preferably absorb light at a 
wavelength of at least about 540 nm, more preferably at least about 649 nm 
and emit fluorescence at a wavelength of at least about 650 nm. more 
preferably at least about 663 nm. The cyclized cyanine dyes also preferably 
have a positive Stoke's shift (^Einission"^Abs.^°^ least about 1 2 nm. 

In particular, cyclized cyanine dyes having General Formula I where R, 
and Rj are taken together to form a 5, 6. 7 or 8 membered ring have been 
found to absorb light and fluoresce when bound to a nucleic acid polymer at 
unexpectedly higher wavelengths than has been previously achieved by 
cyanine dyes where R, and Rj do not form a ring structure. 

Fluorescent cyanine dyes having the General Formula I where R^ and Rj 
are taken together to form a 7 membered ring have also been found to have 
the greatest Stoke's shift ( ^Emission "^Abs J 
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TABLE 1: Absorbance and Emission Maxima of Intercalating Dyes 
in PBS with Excess DNA ( [bpVldye] = 100) 



1 649 663 100X 



r Y T~ 2 654 667 100X 

4 675 690 200X 

^^3^^^^^^^^ 5* 641 655 100X 

Afes^-Absorbance laaxiiaum (bounds to DNA) 
Ms^mx-Emission maximum (bound to DNA) 
t^'^DNf of SSAr""^ enhancement (bounds vs. not bound 
*^Compound 5 is taught in U.S. Patent No. 5,321,130 to 
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Table 1 summarizes the absorbance maximum and fluorescence 
emission maximum wavelengths (both when bound to DNA) of some 
exemplary cyclized cyanine dyes of the present invention. 

As illustrated in Table 1, it was found that the addition of a cyclic aliphatic 
side chain to the basic cyanine dye structure, i.e., formation of a 5-8 
membered ring by combining R, and Rj, was found to increase the absorbance 
and fluorescence emission wavelengths of the con-esponding acyclic cyanine 
dye by about 12 nm. For example, as shown with regard to dyes 2 and 5, dye 
2 has an Abs^g^^ at 654 nm as compared to 641 nm and an EmSp^g^ at 667 nm 
as compared to 655 nm. In addition, dye 4 is the longest wavelength 
trimethine intercalating dye yet reported. 

With regard to n, n may equal 1. Accordingly, the present invention 
includes cyclized cyanine dyes having the General Fonnula II 
(i.e. where n = 1) 




II 



where Y, R^, Rj . R3, R4, R5 . Rj* Ra. R9 and Rio are as specified above. 

Y may be either S or O. and is most preferably S. 

R3 and R4 may each independently be either hydrogen, d - 0,0 alkyi, C, 
- C10 alkoxy, or C, - C^o alkylthio, and are preferably H. 

R5 may be a C, - C50 alkyl. Since DNA and RNA to which the cyclized 
cyanine dyes bind contain negatively charged phosphate backbones, it is 
preferred that R5 be substituted with one or more polar substituents. It is most 
preferred that R5 include one or more positively charged atoms in the polar 
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10 



15 



20 



25 



substituent U.S. Patent No. 5.321.130 to Yue, et al. teaches unsymmetrical 
cyanine dyes having an aminoalkyi chain containing a backbone of 3-42 
carbons and 1-5 positively charged nitrogen atoms. The cationic tall described 
in U.S. Patent No. 5,321,130 exemplifies one of the positively charged R5 
substituents that may be used in combination with the cyclic cyanine dyes of 
the present invention and is incorporated herein by reference. In addition to 
the positively charged substituents described in U.S. Patent No. 5,321.130. 
R„ls also intended to indude aminoalkyi chains including a positively charged 
cydic aminoalkyi group having 1-5 positively charged nitrogen atoms. 

Altematively, R3 may fomi part of a linker between two cydized 
fluorescent cyanine dyes as Illustrated by General Fomiula W 




-(CR3-CR4)n 




n 



(CR4-CR3)n- i ^ 



Rio 



According to this embodiment Y, R„ Rj, R3. R4. R«. R?. Rfl» Rfl and R,o are as 
spectfied above. It should be noted that the two linked cyanine dyes may be 
the same or different cyanine dyes. In general, it is preferred that the linked 
cyanine dyes be the same since different dyes will have different spectral 
properties. 

Rfl and Rt may each independently be either H. Cvw alkyl, or are taken 
together to form a 5 or 6 membered ring, most preferably a 5 or 6 membered 
aromatic ring, optionally substituted with C,^ alkyl or C, - C,o alkoxy groups. 

R, and R^ may each independently be either H. C^to a"^'. or are taken 
together to fonm a 5 or 6 membered ring, most preferably a 5 or 6 membered 
aromatic ring, optionally substituted with C,^ alkyl or - C^o alkoxy groups. 

In general, it is prefen-ed either R« and R^ or Rj and R^ are taken 
together to form a 5 or 6 membered aromatic ring, optionally substituted with 
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C,^ alkyi or - C,o alkoxy groups. The and R7 or Rg and Rg groups that do 
not form the aromatic ring are preferably H. 

R^o may be either H. C,^ alkyl. C, - Ciq aikoxy or a fused benzene. 

In a particulariy prefen^ed embodiment, the cyclized cyanine dye has the 
General Formula V where the ring fomied by R, and Rj includes a positively 
charged substituent R27, As discussed herein, inclusion of a positively charged 
substituent. such as R27 , to a substituent on the positively charged nitrogen on 
the benzothiazole ring improves the net fluorescence enhancement of the dye 
with DNA. 



R27 is a positively charged alkyI substituent which may be attached to any atom 
used to fomn the 5, 6. 7 or 8 membered ring. R27 is more preferably a 
positively charged aminoalkyi substituent. For example. R^j can be an 
aminoalkyi chain containing a backbone of 3-42 carbons and 1-5 positively 
charged nitrogen atoms as described in U.S. Patent No. 5.321,130 to Yue, et 
al. which is incorporated herein by reference. In addition to the positively 
charged substituents described in U.S. Patent No. 5,321,130, R^is also 
intended to include aminoalkyi chains including a positively charged cyclic 
aminoalkyi group having 1-5 positively charged nitrogen atoms. 




R27 



R8 



R9 
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In a preferred embodiment, R^r has the general formula -R2aN(R29R3oR3i) 
where. R28 is a C1.5 alkyi and R29, R30. and R31 are each independently a C^io 
alkyl. 

Table 2 provides examples of some of the preferred cyclized cyanlne 
5 dyes. It should be understood, however, that the dyes listed in Table 2 are 

intended only to exemplify the cyclized cyanine dyes of the present invention 
and are not intended to be limiting. 
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TABLE 2 (cont.) 




-13- 



SUBSTITUTE SHEET (RULE 26) 



wo 97/17471 



PCT/US96/17943 



TABLE 2 (cont.) 
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The present invention also relates to fluorescent cyanine dyes having a 
positively charged substituent attached to the positively charged nitrogen on 
the benzothiazole portion of the cyanine dye. These fluorescent cyanine dyes 
are represented by General Formula VI 




I" CR,3-(CRi4=:CRi5)fr/ j^RlS VI 

H 

Rl9 R20 



where 

n is 0, 1 or 2; 

10 Y may be either S or O; 

R12 is a positively charged alkyi substituent, more 
preferably a positively charged aminoalkyl substituent; 

and R^j may each independently be either 
hydrogen. C, - C,o alkyI, - 0,0 alkoxy. or C, - C,o aikylthio; 
15 R,2 and R^^ may optionally be taken together to form a 5, 

6, 7 or 8 membered ring; 

R18 may be a - alkyl. preferably substituted with 
one or more polar substituents which preferably includes one or more 
positively charged atoms, or a cyclized fluorescent cyanine dye of the 
20 present invention, i.e., where R^^ is a linker between two cyciized 

fluorescent cyanine dyes; 

Ri7 and R^g niay each independently be either H or C^.^o 
alkyI, or may be taken together to form a 5 or 6 membered ring, most 
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preferably a 5 or 6 membered aromatic ring, optionally substituted 
with C,^ aikyi or - 0,0 alkoxy groups; 

Rig and may each independently be either H or Clio 
alkyl. or may be taken together to forni a 5 or 6 membered ring, most 
5 preferably a 5 or 6 membered aromatic ring, optionally substituted 

with C^^ alkyl or Ct - C^o alkoxy groups; and 

Rji may be either H, C,^ alkyl. C, - C,o alkoxy or a fused 

benzene. 

As used above, alkyl and alkoxy refer to any substituent having a carbon 
10 backbone having the specified range of carbon atoms. The carbon backbone 

may form a straight chain, may be branched or may cyclic. The alkyl and 
alkoxy groups may be optionally substituted by a wide variety of substituents 
including, for example, alcohols, amines, thiols, phosphates, halides, ethers, 
esters, ketones, aldehydes, carboxylic acids, amides, cycloalkyls, and aromatic 
15 rings. 

With regard to n, it is noted that n may equal 1. Accordingly, an 
embodiment of the present invention includes cyanine dyes having the General 
Formula VII (i.e. where n = 1) 



20 




Rt9 R20 



where Y, R.j, R^s. R14. R15. Rie. R17. Ria. Ri9» R20 and Rj, are as specified 
above. 
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With regard to dyes having General Fonmula VI or Vll, Y may be either S 
or O and is most preferably S. 

R,2 can be an aminoalkyi chain containing a backbone of 3-42 carbons 
and 1-5 positively charged nitrogen atoms as described in U.S. Patent No. 
5,321,130 to Yue, et al. which is incorporated herein by reference. In addition 
to the positively charged substituents described in U.S. Patent No. 5.321,130, 
R„ is also intended to include aminoalkyi chains including a positively charged 
cyclic aminoalkyi group having 1-5 positively charged nitrogen atoms. 

In a preferred embodiment, has the general fonnula -R28N(R2gR3oR3i) 
where Rjg is a C^^ alkyi and Rjg, R^q, and Rj, are each independently a C,.,o 
alkyL 

In an altemate preferred embodiment. R,2 and R,3 are taken together to 
form a 5, 6, 7 or 8 membered ring where the ring includes a positively charged 
alkyI substituent, more preferably an aminoalkyi chain containing a backbone 
of 3-42 carbons and 1-5 positively charged nitrogen atoms as described in 
U.S. Patent No. 5,321,130 to Yue, et al. Dyes of this embodiment may be 
generally represented by General Fomiula VIII 



R21 



R27 



;c (CRi4=:CRi5)n 




Rl9 R20 



where R,, and R,, represents the atoms necessary to fonn a 5, 6, 7 or 8 
membered ring and R2T is a positively charged substituent, as specified above 
with regard to R,2> which may be attached to any atom used to form the 5, 6, 7 
or 8 membered ring as represented by R,, and R,,. In this regard, these dyes 
are equivalent to the dyes described above having the Genera! Formula V. 
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Ri4 and may each independently be either hydrogen, C^-C^q 
alkyi, Cj-Cio alkylthio, and are preferably H. 

Ri6 may be a Cj-Cjo alkyl. Since DNA and RNA to 
which the cyclized cyanine dyes bind contain negatively 
5 charged phosphate backbones, it is preferred that R,^ be 
substituted with one or more polar substituents. It is 
most preferred that Rj^ include one or more positively 
charged atoms in the polar substituent, such as is 
specified with regard to R,2 above, 

10 The cyanine dyes according to General Formula 

VI, i.e., dyes where a positively charged substituent is 
positioned off the nitrogen of the benzothiazole portion 
of the dye, provide the advantage over previous cyanine 
dyes of exhibiting a significantly larger net fluorescence 

15 enhancement with DNA than cyanine dyes where a positively 
charged substituent is positioned at R^^ alone. 

The use of intercalating dyes for staining cell 
nuclei requires that the dye itself be membrane-permeable 
or that a membrane permeabilizing step be incorporated 

2 0 into the sample preparation. Methods for enabling charged 
molecules and very large molecules into cells include the 
use of chemicals, such as digitonin, freeze-thaw cell 
lysis steps, or the use of non-ionic detergents such as 
TRITON X-100. For speed and simplicity, it is preferred 

25 to add approximately 9mM TRITON X-100. 

The presence of a detergent solution (TRITON X- 
100) causes significant fluorescence enhancement of the 
dyes as compared to in PBS buffer. An increase in 
detergent-enhanced fluorescence (Fxrjton/Fpbs) ^^as the effect 

30 of decreasing the net DNA enhanced fluorescence over 
detergent-enhanced background fluorescence (Fdj^^/Fxrixon) • 
The detergent-enhanced fluorescence is believed to 
increase with increasing hydrophobicity . 
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TABLE 3: Fluorescence Ratios of Dyes in Buffer, 
TRITON X-100 and DNA Solutions 



5 




On+(CH3)3 



* Compounds 5 and 7 are taught in U.S. Patent No. 5,321,130 to Yue, et al. 
10 • Compound 6 is taught In U.S. Patent No. 4,957,870 to Lee. et al. 

Ruorescence enhancement of the dyes upon binding to an excess of 
DNA was found to be fairly constant regardless of how the quinoiinium ring 
side chain was modified (R,fl), Advantageously, however. It was found that 
inclusion of a positiveiy charged substituent off the positively charged nitrogen 
15 of the laenzothiazole portion of the dye (General Formula VI) causes the dye to 

exhibit a significantly larger net DNA-enhancement than the positioning of a 
positively charged substituent at R^^ alone. As a result, smaller concentrations 
of nucleic adds can be detected using cyanine dyes having General Fonmula 
VI. 
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For example, Table 3 compares the fluorescence ratios of dyes in a 
saline buffer, a detergent (TRITON X-100) and In a DMA solution. Dye 
solutions (1.0 \}M) were prepared In phosphate buffered saline (PBS), in PBS 
with TRITON X-100 (9mM), and in PBS with double-stranded DNA (100mM). 

Table 3 shows the effect of various side chains on the fluorescence 
background in TRITON X-100 (9mM). As Illustrated in Table 3, the net DNA 
enhanced fluorescence over detergent-enhanced background fluorescence 
(Pona/Ftoton) was found to be a factor of 5 greater In dye 8 than in dye 7. This 
result is unexpected since the net charge of 3+ Is the same for both dyes 7 and 
8. It appears that both the location and quantity of charges affect the 
fluorescence enhancement of the dyes. 

The cyanine dyes according to General Fonnula VI preferably absorb 
light at a wavelength of at least about 640 nm. more preferably at least about 
649 nm and emit fluorescence at a wavelength of at least about 650 nm. more 
preferably at least about 663 nm. The cyanine dyes also preferably have a 
positive Stickers shift (X£^^j|5siQ^"'X;^bs.) of at least 11 run. 

Table 4 provides examples of some of the preferred cyanine dyes having 
General Fomnula VI. It should be understood, however, that the dyes listed in 
Table 4 are intended only to exemplify the cyanine dyes of the present 
invention and are not Intended to be limiting. 
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TABLE 4 
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TABLE 4 (cont.) 




N+(CH3)3 
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TABLE 4 (cont.) 
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TABLE 4 (cont.) 
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TABLE 4 (cont.) 






N+(CH3)3 
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TABLE 4 (cont.) 
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The present invention also relates to the use of the cyanine dyes having 
General Formulas I, II, IV, V, VI, VII or VIII to fomi compositions for detecting 
the presence of nucleic acids in a sample. In general, the compositions 
include a cyanine dye according to the present invention non-covalently bound 
to a nucleic acid, i.e., DNA or RNA. 

The fluorescence of the cyanine dyes of the present invention 
significantly increase when bound to a nucleic acid. As a result, it is possible 
to qualitatively or quantitatively determine the presence of nucleic acids in a 
sample by monitoring the change in the fluorescence intensity of the dye at a 
wavelength con^esponding to the composition of the dye bound to the nucleic 
acids. Use of cyanine dyes in general for detecting the presence of nucleic 
acids in a sample is known in the art. A discussion regarding the use of 
cyanine dyes to detect the presence of nucleic acids in a sample is provided in 
U.S. Patent No. 5,321,130 to Yue. et al. which is incorporated herein by 
reference. 

The present invention also relates to a method for detecting nucleic acids 
by contacting the nucleic acids with a cyanine dye of the present invention. 
According to the method, a sample of nucleic acids are contacted with a 
cyanine dye of the present invention in order to fomi the composition of a 
cyanine dye non-covalently bound to a nucleic acid sequence. After the dye- 
nucleic acid sequence composition is fonmed. the bound dye is exposed to 
light having a wavelength near an absorbance maximum of the dye when 
bound to a nucleic acid sequence. The resulting fluorescence emission of the 
dye is then detected in order to qualitatively or quantitatively determine the 
presence of nucleic acids in the sample. 
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Fxamole 1 : Preparation nf Compound 4 




1 a. Preparation of 2,3-Tetramethylenenaphth{2. 1 -djthiazolium 
Bromide 




